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ABSTRACT 

Given  a  supply  of  N  weapons  and  a  time  T  in  which  to  operate, 
what  is  the  best  way  to  allocate  the  weapons  among  incoming  targets 
arriving  with  average  rate  \  so  as  to  maximize  the  expected  number 
of  targets  killed?  This  problem  leads  to  a  system  of  ordinary  dif¬ 
ferential  equations  which  can  be  solved  recursively,  and  whose  solutions 
furnish  the  values  of  the  expected  number  of  targets  killed,  as  well 
as  the  optimal  firing  schedule. 
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Suppose  that  we  are  given  N  missiles  which  we  can  fire  singly  or 
in  salvos  at  incoming  targets  which  arrive  at  random  times  with  average 
rate  X.  We  are  given  also  an  upper  limit  T  on  the  amount  of  time  we 
can  operate.  Each  missile  has  the  probability  p  of  killing  a  target. 
What  is  the  best  way  to  allocate  our  missiles  so  as  to  maximize  the 
expected  number  of  targets  killed? 

Instead  of  thinking  in  terms  of  fixed  N  and  T,  let  us  use  arbitrary 
n  and  t,  and  define 

f  (t)  =  expected  number  of  targets  killed  in  the  time 
u  interval  [0,  t]  if  we  have  n  missiles  at  time 

t  =0,  and  we  function  optimally. 


(Of  course,  f  (t)  depends  also  on  p  and  X.)  It  is  clear  that  f  (0)  =  0, 
n  n 

and  f  (t)  is  an  increasing  function  of  n  and  of  t.  Furthermore,  if 
n 

0  <  ^  <  t,  then  our  optimal  policy  in  the  interval  (0,  t),  given  n 
missiles  at  the  beginning,  must  also  be  optimal  in  the  interval  (t^,  t), 
given  n  -  n^  missiles  at  t^,  if  n^  missiles  were  fired  in  (0,  t^. 

Here,  ^  is  a  random  variable  depending  on  how  many  targets  arrived 
in  (0,  t^. 
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Now  let  t^  =  At  be  small.  Then,  neglecting  terms  in  At  and 

higher  order  terms,  there  will  be  no  target  arrivals  in  (0,  At)  with 
probability  1  -  XAt,  and  exactly  one  arrival  with  probability  XAt. 

If  we  fire  j  missiles  at  the  one  target,  our  expected  return  from  this 

salvo  will  be  1  -  qJ,  where  q  *  1  -  p.  Our  expected  return  in  (0,  t) 
is  therefore 


(1  -  XAt)  fn(t  -  At)  +  XAt[l  -  qJ  +  f  (t  -  At)]. 

Evidently  j  must  be  such  that  this  expression  is  as  large  as  possible. 
Furthermore,  it  can  never  pay  to  decline  to  fire  any  missiles  at  a 
target  opportunity  ( if  a  bird  in  hand  is  worth  two  in  the  bush,  how 
much  better  a  bird  in  hand  must  be  compared  to  one  in  the  bush).  It 
follows  that  j  2  1,  and 
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f  (t)  =  (1  -  XAt)  f  (t  -  At) 


n 


n 


+  XAt  max  [l-q^+f  .(t  -  At)] 

ISj^n  n"J 


Consequently, 


fn(t)  -  fn(t  -  At) 
At 


-X  f  (t  -  At) 
n 


+  X  max  Cl  -  <T  +  f  ,(t  -  At)], 


l-j^n 


n-j' 


(1) 


and  if  we  let  At— >0,  we  obtain,  formally, 

f  (t)  +  X  f  (t)  =  X  max  [1  -  qJ  +  f  (t)], 

l£j*n  n-J 


fr  (e^‘t  f  (t))  =  max  Cl  -  q1^  +  f  ,(t)].  (2) 

dt  n  n"J 


(We  can  prove  (2)  rigorously  as  follows.  fn(t)  is  a  monotone  function 

of  t  for  each  n.  Therefore  it  is  continuous  almost  everywhere  and 
differentiable  almost  everywhere.  Consequently  (2)  holds  almost  every¬ 
where.  Since  fR(t)  ^  n,  the  right  side  of  (l)  is  a  bounded  function 

of  t,  and  since  (l)  holds  for  all  t--except  for  terms  of  order  At--it 
follows  that  fn(t )  is  absolutely  continuous,  etc.) 

From  (2),  we  can  calculate  fn(t)  recursively.  In  fact,  we  have 
evidently 
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fQ(t)  =0, 


for  all  t.  Therefore,  from  (2), 


ft  (eU  fx(t))  -  X  eU(l  -  q)  - 


.  Xt 
P  X  e  , 


fx(t)  =  p(l  -  e-Vt). 


For  n  =2,  we  have 


It  <=u 


,  1  -  q  +  p(l  -  e'At), 

X  e  max  p 

1  -  q 


Biit  the  maximum  on  the  right  side  is  the  function 


=  1  -  q 


if  t< 


-  p(£  -  e"*^)  if  t  >  ^  log  ^  . 


Consequently 


f2(t) 


(1  -  q2)(l  -  e‘U)  if  t  <  l  log  i  , 
2p  -  e"^[3P  -  p2  +  Xpt  -  p  log  j] 
if  t  *  J  log  J  . 
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In  addition,  we  see  that  for  n  =  2,  we  must  fire  two  missiles  at  the 
first  target  if  the  time  remaining  after  its  arrival  is  less  than 

i  log  — ,  and  we  fire  one  missile  at  the  first  target  in  the  contrary 
a  p 

case,  i.e.,  if  the  time  remaining  after  the  first  arrival  exceeds 


In  general,  when  f^(t),  . ..,  f  ^(t)  are  known  for  all  t,  we  can 

calculate  the  right  side  of  (2)  for  all  t,  integrate,  and  get  fn(t). 

This  is  not  easy  to  do  analytically  (already  for  n  =  3>  ®  transcen¬ 
dental  equation  is  encountered),  but  it  is  perfectly  feasible  on  a 
computer.  (The  parameter  X  does  not  add  any  complexity,  of  course. 

By  changing  the  unit  of  time,  we  can  suppose  that  X  =  1. ) 


Once  we  have  f  (t)  for  0  £  t  ^  T,  and  1  ^  n  ^  N,  we  also  have 
n  (n) 

the  required  optimal  firing  schedule.  In  fact,  let  a^  be  the  value 

of  t  for  which 


1  - 


n-j+1 
q  0  + 


1  -  <rJ .  f/t). 


J  .  1,  2.  n  -  1.  Then  0  <  a,n^  <  a(n^  <  ...  <  a^nX  ard  if  we 

u  ’  *  ’  12  n-1 

have  n  missiles,  then  on  the  arrival  of  the  first  target,  we  must  fire 

j  missiles  if  the  time  remaining  after  this  arrival  is  in  the  time 

interval 


(a(n)  a(n)  ) 

®n-j  '  Vj+l  ’> 


J+l 


in  which  we  interpret  =0, 


+ 


This  follows,  of  course,  from  the  discussion  preceding  (l).  After  we 
have  fired  the  j  missiles,  we  have  n  -  j  left,  and  we  employ  the  same 
philosophy  when  the  second  target  arrives  (given  n  -  j  missiles,  this 
time),  etc. 
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It  follows  from  the  above,  and  it  is  also  intuitively  clear,  that 
if  we  have  a  long  time  to  operate,  we  should  fire  one  missile  at  the 
first  target,  one  at  the  second,  etc.  Our  return  will  be  np,  if  we 
have  n  missiles  to  start  with.  Therefore, 


lim  f  (t)  =  np  (5) 

t  — 


(cf.  (3)  and  (4)). 

Suppose  p  =  1.  Then  the  optimal  policy  is  to  fire  one  missile 
at  each  target.  If,  in  the  interval  (0,  t),  there  are  exactly  v  tar¬ 
get  arrivals,  our  return  will  be 

«*  v,  if  v  ^  n  , 

=  n  if  v  >  n. 


The  probability  of  exactly  v  arrivals  in  (0,  t)  is  e  ^  ^7^-  ,  v  *  0, 

V* 

1,  2,  ...  .  Therefore  we  have,  for  p  =  1, 


f  (t) 
n 


n 


L 

v=0 


or 


00 


v=n+l 


9 


v=0 


(H)v  _  (lt)n+1 

vl  nt 


(P  =  1). 
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The  most  Important  part  of  our  problem  is  the  determination  of 
the  "cross-over"  times  a'.  defined  above,  in  terms  of  which  the 

J  (n) 

optimal  firing  policy  is  given.  For  fixed  n,  the  a;.  are  bunched 
up  near  t  =  0  for  the  first  few  j's.  For  small  t,  we  have 


f  (t)  =  (1  -  qn)(l  -  e“Xt), 


(6) 


(n) 

and  the  smaller  n  is,  the  larger  will  be  the  interval  (0,  a^  )  in 
which  (6)  is  valid.  Now  a^n^  is  the  value  of  t  for  which 

1  -  q  =  1  -  q  +  f^t)  =  1  -  q  +p(l-e  ). 


Therefore 


a^n)  =  log  (1  -  q11'1)  . 

/  \ 

Siml  larly,  a .  is  the  value  of  t  for  which 

J 

1  .  qn-j+1  +  f  (t)  =  1  -  q11'*5  +  f  (t)  , 


(7) 


which  becomes,  using  (6)--valid  for  small  n  and  small  t-- 


n- j  j  — 1  /  -  — a.  u  \ 

q  P  =  q  P(1  -  e  )  , 


-Xt , 


or 


(n)  1  ,  n-2,j+l»  ,  , 

'  =  -  r-  log  (1  -  q  )  ,  j  <  <  n. 


(8) 


For  large  n,  with  j  <  <  n,  this  is  practically 
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(n)  1  n-3J+l 

j  “  \  q 


For  j  nearly  equal  to  n,  the  most  interesting  case,  we  have  not  been 
able  to  derive  approximate  values. 
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